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Abstract 

In this paper, we investigate the error correction capability of column-weight-three LDPC codes when decoded 
using the Gallager A algorithm. We prove that the necessary condition for a code to correct k > 5 errors is to avoid 
cycles of length up to 2k in its Tanner graph. As a consequence of this result, we show that given any a > 0, 3N 
such that Vn > N, no code in the ensemble of column-weight-three codes can correct all an or fewer errors. We 



j> . extend these results to the bit flipping algorithm. 

£T) • Index Terms 

d : 

' Low-density parity-check codes, Gallager A algorithm, trapping sets, error correction capability 

o ' 



I. Introduction 

Gallager in [1] showed that for 7 > 3 and p > 7, there exist (n, 7, p) regular low-density parity-check 
(LDPC) codes for which the bit error probability tends to zero asymptotically whenever we operate below 
the threshold. Richardson and Urbanke in [2] derived the capacity of LDPC codes for various message 
passing algorithms and described density evolution, a deterministic algorithm to compute thresholds. 
Zyablov and Pinsker [3] analyzed LDPC codes under a simpler decoding algorithm known as the bit 
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flipping algorithm and showed that almost all the codes in the regular ensemble with 7 > 5 can correct 
a constant fraction of worst case errors. Sipser and Spielman in [4] used expander graph arguments to 
analyze bit flipping algorithm. Burshtein and Miller in [5] applied expander based arguments to show 
that message passing algorithms can also correct a fixed fraction of worst case errors when the degree 
of each variable node is at least five. Feldman et al. [6] showed that linear programming decoder [7] 
is also capable of correcting a fraction of errors. Recently, Burshtein in [8] showed that regular codes 
with variable nodes of degree four are capable of correcting a linear number of errors under bit flipping 
algorithm. He also showed tremendous improvement in the fraction of correctable errors when the variable 
node degree is at least five. 

In this paper, we consider the error correction capability of the ensemble C"(3, p > 3) of (3, p) regular 
LDPC codes as defined in [2] when decoded using the Gallager A algorithm. We analyze decoding failures 
using the notion of trapping sets and prove that a code with girth g > 10 cannot correct all g/2 or fewer 
errors. Using this result, we prove that for any a > 0, for sufficiently large block length n, no code in 
the C n (3,p) ensemble can correct a fraction of errors. This result settles the problem of error correction 
capability of column-weight-three codes. The rest of the paper is organized as follows. In Section [XT] we 
establish the notation and describe the Gallager A algorithm. We then characterize the failures of the 
Gallager A decoder with the help of fixed points. We also introduce the notions of trapping sets, failure 
sets and critical number. In Section [III] we investigate the relation between error correction capacity and 
girth of the code. We extend the results to bit flipping algorithm in Section [IV] and conclude in Section 

m 

II. Decoding Algorithms and Trapping Sets 

A. Graphical Representations of LDPC Codes 

LDPC codes [1] are a class of linear block codes which can be defined by sparse bipartite graphs 
[9]. Let Q be a bipartite graph with two sets of nodes: n variable nodes and m check nodes. The check 



nodes (variable nodes) connected to a variable node (check node) are referred to as its neighbors. The 
degree of a node is the number of its neighbors. This graph defines a linear block code C of length n and 
dimension at least n — m in the following way: The n variable nodes are associated to the n coordinates 
of codewords. A vector v = (v 1: v 2: ■ ■ . , v n ) is a codeword if and only if for each check node, the sum of 
its neighbors is zero. Such a graphical representation of an LDPC code is called the Tanner graph [10] of 
the code. The adjacency matrix of Q gives H, a parity check matrix of C. An (n, 7, p) regular LDPC code 
has a Tanner graph with n variable nodes each of degree 7 (column weight) and rvy/p check nodes each 
of degree p (row weight). This code has length n and rate r > 1 — 7/p [9]. In the rest of the paper we 
consider codes in the (3,p), p > 3, regular LDPC code ensemble. Note that the column weight and row 
weight are also referred to as left degree and right degree in literature. It should also be noted that the 
Tanner graph is not uniquely defined by the code and when we say the Tanner graph of an LDPC code, 
we only mean one possible graphical representation. The girth g is the length of the shortest cycle in Q. 
In this paper, • represents a variable node, □ represents an even degree check node and ■ represents an 
odd degree check node. 

B. Hard Decision Decoding Algorithms 

Gallager in [1] proposed two simple binary message passing algorithms for decoding over the binary 
symmetric channel (BSC); Gallager A and Gallager B. See [9] for a detailed description of Gallager B 
algorithm. For column-weight-three codes, which are the main focus of this paper, these two algorithms 
are the same. Every round of message passing (iteration) starts with sending messages from variable nodes 
(first half of the iteration) and ends by sending messages from check nodes to variable nodes (second half 
of the iteration). Let r, a binary n-tuple be the input to the decoder. Let cjj(v, c) denote the message passed 
by a variable node v to its neighboring check node c in j th iteration and zuj(c,v) denote the message 
passed by a check node c to its neighboring variable node v. Additionally, let ujj(v, : ) denote the set of 
all messages from v, idj(v, : \c) denote the set of all messages from v except to c, , c) denote the 
set of all messages to c. uOj(: \v,c),zuj(c, : ),zuj(c, : \v),zuj(: ,v) and zuj(: \c,v) are defined similarly. 



The Gallager A algorithm can be defined as follows. 
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At the end of each iteration, an estimate of each variable node is made based on the incoming messages 
and possibly the received value. The decoded word at the end of j th iteration is denoted as . The decoder 
is run until a valid codeword is found or a maximum number of iterations M is reached, whichever is 
earlier. The output of the decoder is either a codeword or r^ M \ 

A Note on the Decision Rule: Different rules to estimate a variable node after each iteration are possible 
and it is likely that changing the rule after certain iterations may be beneficial. However, the analysis of 
various scenarios is beyond the scope of this paper. For column-weight-three codes only two rules are 
possible. 

• Decision Rule A: if all incoming messages to a variable node from neighboring checks are equal, 
set the variable node to that value; else set it to received value 

• Decision Rule B: set the value of a variable node to the majority of the incoming messages; majority 
always exists since the column-weight is three 

We adopt Decision Rule A throughout this paper. 

C. Trapping Sets of Gallager A Algorithm 

We now characterize failures of the Gallager A decoder using fixed points and trapping sets [11]. 
Consider an LDPC code of length n and let x be the binary vector which is the input to the Gallager A 
decoder. Let «S(x) be the support of x. The support of x is defined as the set of all positions % where 
x(i) 7^ 0. Without loss of generality, we assume that the all zero codeword is sent over BSC and that 



the input to the decoder is the error vector. Hence, throughout this paper a message of 1 is alternatively 
referred to as an incorrect message, a received value of 1 is referred to as an initial error. 

Definition 1: [11] A decoder failure is said to have occurred if the output of the decoder is not equal 
to the transmitted codeword. 

Definition 2: x is called a fixed point if 

u)j(v, c) = x(t>), Vj > 

That is, the message passed from variable nodes to check nodes along the edges are the same in every 
iteration. Since the outgoing messages from variable nodes are same in every iteration, it follows that 
the incoming messages from check nodes to variable nodes are also same in every iteration and so is 
the estimate of a variable after each iteration. In fact, the estimate after each iteration coincides with the 
received value. It is clear from above definition that if the input to the decoder is a fixed point, then the 
output of the decoder is the same fixed point. 

Definition 3: [12] Let x be a fixed point. Then <S(x) is known as a trapping set. A (V, C) trapping set 
T is a set of V variable nodes whose induced subgraph has C odd degree checks. 

Theorem 1: Let C be a code in the ensemble of (3, p) regular LDPC codes. Let T be a set consisting 
of V variable nodes with induced subgraph X. Let the checks in X be partitioned into two disjoint subsets; 
O consisting of checks with odd degree and £ consisting of checks with even degree. Let \0\ = C and 
\£\ = S. T is a trapping set iff : (a) Every variable node in X is connected to at least two checks in £ 
and (b) No two checks of O are connected to a variable node outside X. 

Proof: See Appendix U ■ 

We note that Theorem [I] is a consequence of Fact 3 in [11]. We also remark that Theorem Q] can be 
extended to higher column weight codes but in this paper we restrict our attention to column-weight-three 
codes. 

If the variable nodes corresponding to a trapping set are in error, then a decoder failure occurs. However, 
not all variable nodes corresponding to trapping set need to be in error for a decoder failure to occur. 



Definition 4: [12] The minimal number of variable nodes that have to be initially in error for the 
decoder to end up in the trapping set T will be referred to as critical number for that trapping set. 

Definition 5: A set of variable nodes which if in error lead to a decoding failure is known as a failure 
set. 

Remarks 

1) To "end up" in a trapping set T means that, after a possible finite number of iterations, the decoder 
will be in error, on at least one variable node from T, at every iteration [11]. 

2) The notion of a failure set is more fundamental than a trapping set. However, from the definition, 
we cannot derive necessary and sufficient conditions for a set of variable nodes to form a failure 
set. 

3) A trapping set is a failure set. Subsets of trapping sets can be failure sets. More specifically, for a 
trapping set of size V, there exists at least one subset of size equal to the critical number which is 
a failure set. 

4) The critical number of a trapping set is not fixed. It depends on the outside connections of checks 
in £. However, the maximum value of critical number of a (V, C) trapping set is V. 



Example 1: Fig ]l(a)| shows a subgraph induced by a set of three variable nodes {^1,^2,^3} • If no 
two odd degree check nodes from {c 4 , c 5 , c 6 } are connected to a variable outside the subgraph, then by 
Theorem [T] Fig ]l(a)| is a (3, 3) trapping set. On the other hand, if two odd degree checks, say c 5 and 
c 6 , are connected to another variable node, say V4, the subgraph resembles Fig. |l(b)| Assuming no other 
connections, Fig ]l(b)| is a (4,2) trapping set. We make the following observations: 

1) The three variable nodes in a (3, 3) trapping set form a six cycle. However, not all six cycles are 
(3, 3) trapping sets. Apart from the subgraph induced by variable nodes, the outside connections 
should be known to determine whether a given subgraph is a trapping set or not. The (4, 2) trapping 
set in Fig ]l(b)| illustrates this point. 

2) The critical number of a (3, 3) trapping set is three. There exist (4, 2) trapping sets with critical 



number three and it is highly unlikely that a (4, 2) trapping set does not contain a failure set of size 
three. However, we can show by a counterexample that this is indeed possible. 

3) A (V, C) trapping set is not unique i.e., two trapping sets with same V and C can have different 
underlying topological structures (induced subgraphs). So, when we talk of a trapping set, we refer 
to a specific topological structure. In this paper, the induced subgraph is assumed to be known from 
the context. 

4) To avoid a trapping set in a code, it is sufficient to avoid topological structures isomorphic to the 

it is 



subgraph induced by the trapping set. For example to avoid (3, 3) trapping sets of Fig 1 1(a) 



sufficient to avoid six cycles. It is possible that a code has six cycles but no (3, 3) trapping sets. In 
this case all six cycles are part of (4, 2) or other trapping sets. 





(a) (b) 
Fig. 1. Examples of trapping sets |(a)| a (3,3) trapping set |(b)| a (4,2) trapping set 



III. Error Correction Capability and Girth of the Code 

Burshtein and Miller in [5] applied expander based arguments to message passing algorithms. They 
analyzed ensembles of irregular graphs and showed that if the degree of each variable node is at least 
five, then message passing algorithms can correct a fraction of errors. Codes with column weight three 
and four cannot achieve the expansion required for these arguments. Recently, Burshtein in [8] developed 
a new technique to investigate the error correction capability of regular LDPC codes and showed that at 



sufficiently large block lengths, almost all codes with column weight four are also capable of correcting a 
fraction of errors under bit flipping algorithm. For column-weight-three codes he notes that such a result 
cannot be proved. This is because a non negligible fraction of codes have parallel edges in their Tanner 
graphs and such codes cannot correct a single worst case error. 

In this paper we prove a stronger result by showing that for any given a > 0, at sufficiently large block 
lengths n, no code in the C n (3, p) ensemble can correct all an or fewer errors under Gallager A algorithm 
and show that this holds for the bit flipping algorithm also. 

Lemma 1: [8] A code whose Tanner graph has parallel edges cannot correct a single worst case error. 
Proof: See [8]. The proof is for bit flipping algorithm, but also applies to Gallager A algorithm. ■ 

Lemma 2: Let C be an (n, 3, p) regular LDPC code with girth g = 4. Then C has at least one failure 
set of size two or three. 

Proof: See Appendix HB ■ 
Lemma 3: Let C be an (n, 3, p) regular LDPC code with girth g = 6. Then C has least one failure set 
of size three or four. 

Proof: Since g = 6, there is at least one six cycle. Without loss of generality, we assume that 
{t>i, t> 2 , t>3} together with the three even degree checks {ci,c 2 ,c 3 } and the three odd degree checks 



{c 4 , C5, cq} form a six cycle as in Fig ]l(a)| If no two checks from {c 4 , C5, cq} are connected to a variable 
node, then {v x , v 2 , v 3 } is a (3, 3) trapping set and hence a failure set of size three. On the contrary, assume 
that {vi, t>2, v 3 } do not form a (3, 3) trapping set. Then there exists t> 4 which is connected to at least two 
checks from {c 4 , c 5 , c 6 }. If t> 4 is connected to all the three checks, {vi, v 2 , v 3, t> 4 } is a codeword of weight 
four and it is easy to see that {i>i,i>2, ^3} is a failure set. Now assume that f 4 is connected to only two 
checks from {c 4 ,c 5 ,c 6 }. Without loss of generality, let the two checks be c 5 and c 6 . Let the third check 
connected to t> 4 be c-j as shown in Fig ]l(b)| If c 4 and C7 are not connected to a common variable node 
then {v±, V2, t>3, v&\ is a (4, 2) trapping set and hence a failure set of size four. If c 4 and cj are connected 
to say i> 5 , we have two possibilities: (a) The third check is c 8 and (b) The third check of v 5 is c 2 (the third 



Ui(v, :) 



check cannot be c\ or c 3 as this would introduce a four cycle). We claim that in both cases {v i, t> 2 , t> 3 , t> 4 } 
is a failure set. The two cases are discussed below. 
Case (a): Let S(r) = {vi,v 2 ,v 3 ,v 4 }. 

1, V e {V!,V2,V 3 ,V4} 

0, otherwise 

The messages in the second half of first iteration are, 

1, V e {V!,V 2 } 

0, otherwise 

Similar equations hold for c 2 ,c 3 ,c 5 ,c 6 . For c 4 we have 

{0, v = vi 
1, otherwise 

Similar equations hold for c 7 . At the end of first iteration, we note that v 2 and v 3 receive all incorrect 
messages, Vi,v 4 and v 5 receive two incorrect messages and all other variable nodes receive at most one 
incorrect message. We therefore have = r and ^(r^ 1 )) = {v 1, v 2 , t>3, f/t}. The messages sent by variable 
nodes in the second iteration are, 

uj 2 (v,:) = l,v e {v 1 ,v 2 ,v 3 ,v 4 } 

^2(^5, c 8 ) = 1, 
uj 2 (v 5 , {c 4 ,c 7 }) = 0, 

u 2 (v,:) = 0,v e {vi, . . . ,v n } \ {vi, v 2 , v 3 , v 4 , v 5 }. 

The messages passed in second half of second iteration are same as in second half of first iteration, except 
that zu(c 8 , : \v 5 ) = 1. At the end of second iteration, we note that v 2 and v 3 receive all incorrect messages, 
t>i,f 4 and t> 5 receive two incorrect messages and all other variable nodes receive at most one incorrect 
message. The situation is same as at the end of first iteration. The algorithm runs for M iterations and 
the decoder outputs = r which implies that {v 1, v 2) v 3 , v 4 } is a failure set. 



Case (b): The proof is along the same lines as for Case (a). The messages for first iteration are the 
same. The messages in the first half of second iteration are, 

lu 2 (v,:) = l,v e {v 1 ,v 2 ,v 3 ,v 4 } 

UJ 2 (v 5 ,C 2 ) = 1, 

^2(^5, {c 4 ,c 7 }) = 0, 

u 2 (v, :) = 0,v e{v 1 ,...,v n }\{v 1 ,v 2 ,v 3 ,v 4: ,v 5 }. 

The messages passed in second half of second iteration are same as in second half of first iteration, except 
that vj(c 2 , : \{v 2 , v$, V5}) = 1 and w(c 2 , {v 2 , u 3 , v$}) = . At the end of second iteration, vi, v 2 , v 3 , t> 4 and 
v$ receive two incorrect messages and all other variable nodes receive at most one incorrect message and 
hence r^ 2 ^ = r. The messages passed in first half of third iteration (and therefore subsequent iterations) 
are same as the messages passed in first half of second iteration. The algorithm runs for M iterations and 
the decoder outputs r^ M ^ = r which implies that {vi, v 2 , v 3 , V4} is a failure set. ■ 
Lemma 4: Let C be an (n, 3, p) regular LDPC code with girth g = 8. Then C has at least one failure 
set of size four or five. 

Proof: See Appendix Hfl ■ 
Remark: It might be possible that Lemmas [2HH can be made stronger by further analysis, i.e., it might 
be possible to show that a code with girth four has a failure set of size two, a code with girth six has 
failure set of size three and a code with girth eight has a failure set of size four. However, these weaker 
lemmas are sufficient to establish the main theorem. 

Lemma 5: Let C be an (n, 3, p) regular LDPC code with girth g > 10. Then the set of variable nodes 
{v 1, v 2 , . . . , Vg/ 2 } involved in the shortest cycle is a trapping set of size g/2. 

Proof: Since C has girth g, there is at least one cycle of length g. Without loss of generality, assume 
that {v\,v 2 , . . . , v g / 2 } form a cycle of minimum length as shown in Fig|2] Let the even degree checks be 
£ = {ci, c 2 , • • • , c g / 2 } and the odd degree checks be O = {c s / 2 +i, c g / 2+2 , . . . , c g }. Note that each variable 



node is connected to two checks from S and one check from O and c g / 2 +i is connected to t>j. We claim 
that no two checks from O can be connected to a common variable node. 

The proof is by contradiction. Assume q and Cj (g/2 + 1 < i < j < g) are connected to a variable 
node Vij. Then {t> j, . . . , Vj, form a cycle of length 2(j — i + 2) and {t^-, . . . v g / 2 , v i, . . . , Vi, %} form 
a cycle of length 2(p/2 - j + i + 2). Since g > 10, 



This implies that there is a cycle of length less than g, which is a contradiction as the girth of the graph 
is g. 



Fig. 2. Illustration of a cycle of length g 

Corollary 1: For a code to correct all k > 5 or fewer errors, it is necessary to avoid all cycles up to 
length 2k. 

We now state and prove the main theorem. 

Theorem 2: Consider the standard (3, p) regular LDPC code ensemble. Let a > 0. Let iV be the 
smallest integer satisfying 



min(2(j -i + 2), 2{g/2 -j + i + 2))<g. 



By Theorem [H {v x , v 2 , . . . , Vg/2} is a trapping set. 




c g/2 



aN > 




aN > 5. 



Then, for n > N, no code in the C n (3, p) ensemble can correct all an or fewer errors. 



Proof: First observe that for any n > N, we have 



an > 2 



log (20-1)) 



logn 



+ 1 



) 



(1) 



From [Theorem C.l [1]] and [Lemma C.l [1]], we have the girth g of any code in C n (3,p) is bounded 

by 



For n > N, Equations (0Q) and (O imply that for any code in the C™(3, p) ensemble, the girth is bounded 



The bit flipping algorithm does not belong to the class of message passing algorithms. However, the 
definitions from Section Hi] and the results from Section [III] can be generalized to the parallel bit flipping 
algorithm [4]. Without loss of generality we assume that the all zero codeword is sent. We begin with a 
few definitions. 

Definition 6: [4] A variable node is said to be corrupt if it is different from its original sent value. In 
our case, a variable node is corrupt if it is 1. A check node is said to be satisfied if it is connected to 
even number of corrupt variables and unsatisfied otherwise. 

Definition 7: Let r be the input to the parallel bit flipping decoder. S(r) is a trapping set for bit flipping 
algorithm if the set of corrupt variables after every iteration is S(r). 

Theorem 3: Let T be a set of variable nodes satisfying the conditions of Theorem [Q Then T is a 
trapping set for the bit flipping algorithm. 

Proof: Let S(r) = T. Then T is the set of corrupt variable nodes. Observe that a variable flips if it 
is connected to at least two unsatisfied checks. Since no variable is connected to two unsatisfied checks, 
the set of corrupt variable nodes is unchanged and by definition T is a trapping set. ■ 




(2) 



by 



g < 2an. 



The result now follows from Corollary [TJ 



IV. Extension to the Bit Flipping Algorithm 



We note that Theorem [3] is also a consequence of Fact 3 from [11]. 

Corollary 2: A trapping set for Gallager A is also a trapping set for bit flipping algorithm. 
It can be shown that Lemmas [l]-[5] and Theorem [2] also hold for the bit flipping algorithm. 



V. Conclusion 

In this paper we have investigated the error correction capability of column-weight-three codes under 
Gallager A and extended the results to bit flipping algorithm. Future work includes investigation of 
sufficient conditions to correct a given number of errors for column- weight-three as well as higher column 
weight codes. 

Appendix I 

Proof of Theorem\T} Let r be the input to the decoder with S(r) = T. Then, 

l, veT 



:) 



Let a check node c Q e O. Then, 



■&i(c ,v) 



0, otherwise 



o, v e T 



1, otherwise 



Let a check node c e e £. Then, 



l, veT 

0, otherwise 

For any other check node c, W\(c, v) = 0. By the conditions of the theorem, at the end of first iteration, 
any veT receives at least two l's and any v ^ T receives at most one 1. So, we have 

1, veT 



u 2 (v, :) 

By definition, T is a trapping set. 



0, otherwise 



To see that the conditions stated are necessary observe that for a variable node to send the same 
messages as in the first iteration, it should receive at least two messages which coincide with the received 
value. 



Appendix II 

Proof of Lemma \2\- Let {vi,v 2 } be the variable nodes that form a four cycle with even degree checks 
{01,02} and odd degree checks {03,04}. If C3 and C4 are not connected to a common variable node, 
then {vi,v 2 } is a (2,2) trapping set and hence a failure set of size two. Now assume that c 3 and c 4 are 
connected to a common variable node t> 3 . Then, {v\, v 2 , V3} is a (3, 1) trapping set and therefore a failure 
set of size three. ■ 



Proof of Lemma^ Let %_ = {v%, v 2 , v 3 , t> 4 } be the variable nodes that form an eight cycle (see Fig |3(a)[ ) . 
If no two checks from {c 5 , c 6 , c 7 , c 8 } are connected to a common variable node, then 71 is a (4, 4) trapping 
set and hence a failure set of size four. On the other hand, if Ti is not a trapping set, then there must 
be at least one variable node which is connected to two checks from {c 5 , c 6 , c 7 , c 8 }. Assume that c 5 and 
C7 are connected to v 5 and the third check of v 5 is c 9 (see Fig ]3(b)[ ). We claim that T 2 = T\ U {v 5 } is a 
failure set. Let £ and O be as defined in Theorem [Q 



C 5 



C 4 



A 



C3 



C 6 



'I 

T\ 



c 6 



C 4L 



C5 C 9 
C 8 V 5 XC, 



C 2 



eg 



v 4 



C3 



(a) (b) 
Fig. 3. Subgraphs isomorphic to |(a)| a (4,4) trapping set |(b)| a (5,3) trapping set 



Case 1: No two checks from O = {c 6 , c 8 , c g } are connected to a common variable node. Then T 2 is a 
(5, 3) trapping set and hence a failure set of size five. 

Case 2: All the three checks in O are connected to a common variable node, say v e . Then T 2 U {v 6 } 
is a codeword of weight six and it is easy to see that T 2 is a failure set. 

Case 3: There are variable nodes connected to two checks from O. There can be at most two such 
variable nodes (if there are three such variable nodes, they will form a cycle of length less than or equal 
to six violating the condition that the graph has girth eight). Note that if S(r) = T 2 , the decoder has a 
chance of correcting only if a check node in 8 receives an incorrect message from a variable node outside 
T 2 in some j th iteration. We now prove that this is not possible. Indeed in the first iteration 

l, veT 2 

wi(v,:) = < 

0, otherwise 

By similar arguments as in the proof for Theorem [T] it can be seen that the only check nodes which send 
incorrect messages to variable nodes outside T 2 are c 6 , c 8 and c 9 . There are now two subcases. 

Subcase 1: There is one variable node connected to two checks from O. Let t> 6 be connected to c 6 
and c 8 . It can be seen that the third check connected to vq cannot belong to 8 as this would violate the 
girth condition. So, let the third check be c w . In the first half of second iteration, we have 

{1, v eT 2 or (v,c) = (f 6) ci ) 
0, otherwise 

The only check nodes which send incorrect messages to variable nodes outside T 2 , are c 6 , c 8 , Cg and c 1Q . 
The variable node vq is connected to cq and c 8 . If eg and cio are not connected to any common variable 
node, we are done. On the other hand, let Cg and c w be connected to a variable node, say v 7 . The third 
check of v 7 cannot be in 8. Proceeding as in the case of proof for Lemma |3l we can prove that T 2 is a 
failure set by observing that there cannot be a variable node outside T 2 which sends an incorrect message 
to a check in 8. 



Subcase 2: There are two variable nodes connected to two checks from O. Let c 6 and c 8 be connected 
to t> 6 and c 6 and c 9 connected to v 7 . Proceeding as above, we can conclude that T 2 is a failure set. 
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